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We present a search for the lepton flavor violating decay modes — j- h'^rl {h — K,n; £ = e,/i) 
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PACS numbers: 13.25.Hw, 14.40.Nd 

I. INTRODUCTION 

The standard model (SM) of electroweak interactions 
does not allow charged lepton flavor violation or flavor 
changing neutral currents (FCNC) in tree-level interac- 
tions Lepton flavor violating decays of B mesons 
can occur at the one-loop level through processes that 
involve neutrino mixing, but these are highly suppressed 
by powers of rn^/rn^ [3| and have predicted branching 
fractions many orders of magnitude below the current 
experimental sensitivity. However, in many extensions of 
the SM, B decays involving lepton flavor violation and/or 
FCNC interactions are greatly enhanced In some 

cases, decays involving the second and third generations 
of quarks and leptons are particularly sensitive to physics 
beyond the SM [|. 

Until recent years, experimental information on B de- 
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cays to final states containing r leptons has been weak 
or absent. The presence of at least one neutrino from 
the r decay prevents direct reconstruction of the r, mak- 
ing it difficult to distinguish B — > Xt decays from the 
abundant semileptonic B — >■ Xiv; i = e,ii decays. The 
high-luminosity B factory experiments have developed 
the technique of using a fully-reconstructed hadronic B 
decay (the "tag" B) to determine the three-momentum 
of the other B (the "signal" B) in r(4S') BB events, 
which enables the r to be indirectly reconstructed. This 
technique assigns all detected tracks and neutral objects 
to either the tag B or the signal B. Recent applica- 
tions of this technique by BaBAR are the searches for 
B+ K+T^i 0, B° £±tT and B+ t+v B. We 
present an update of our search for i?+ — > K^Tji [0| and 
the first search for the decays 5+ — K^re, — >■ tt+T/U, 
and B+ tt+tb [9]- 

The signal branching fraction is determined by using 
the ratio of the number of B — >■ hri {h = K^,tt^) sig- 
nal candidates to the yield of control samples of B+ 
T)i*)og+jy^ £)0 j^+jj-- events from a fully reconstructed 
hadronic B^ decay sample. Continuum background is 
suppressed for each decay channel using a likelihood ratio 
based on event shape information, unassociated calorime- 
ter clusters, and the quality of muon identification for 
channels that have a muon in the final state. Final sig- 
nal candidates are selected requiring the indirectly recon- 
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structed r mass to fall in a narrow window around the 
known r mass. The yield and estimated background in 
the r mass signal window are used to estimate and set up- 
per limits on the signal branching fractions. We followed 
the principle of a blind analysis, to avoid experimenter's 
bias, by not revealing the number of events in the signal 
window until after all analysis procedures were decided. 



II. DATA SAMPLE AND DETECTOR 
DESCRIPTION 

We use a data sample of 472 million BB pairs in 
429 fb~^ of integrated luminosity, delivered by the PEP- 
II asymmetric-energy e'^e~ collider and recorded by the 
BaBAR experiment at the SLAC National Accelerator 
Laboratory. This corresponds to the entire T(45') data 
sample. 

The BaBAR experiment is described in detail else- 
where Trajectories of charged particles are re- 
constructed by a double-sided, five-layer silicon vertex 
tracker (SVT) and a 40-layer drift chamber (DCH). The 
SVT provides precision measurements for vertex recon- 
struction and stand-alone tracking for very low mo- 
mentum tracks, with transverse momentum less than 
120MeV/c. The tracking system is inside a 1.5 T su- 
perconducting solenoid. Both the SVT and the DCH 
provide specific ionization (dE/dx) measurements that 
are used in particle identification (PID). Just beyond the 
radius of the DCH lies an array of fused silica bars which 
are part of the detector of internally refiected Cherenkov 
radiation (DIRC). The DIRC provides excellent charged- 
hadron PID. A CsI(Tl) crystal electromagnetic calorime- 
ter (EMC) is used to reconstruct photons and identify 
electrons. The minimum EMC cluster energy used in 
this analysis is 30 MeV. The iron of the fiux return for 
the solenoid is instrumented (IFR) with resistive plate 
chambers and limited streamer tubes, which are used in 
the identification of niuons. 

Monte Carlo (MC) simulated samples for our B hrl 
signals and for all relevant SM processes are generated 
with EvtGen [lH. We model the BaBAR detector re- 
sponse using Geant4 The B — > hri decays are 
generated using a uniform three-body phase space model 
and the background MC sample combines SM processes: 
e+e^ — > T{4S) — ?> BB, e+e" ~> qq {q — u,d,s,c), and 
e+e^ T^T~ . The number of simulated Monte Carlo 
events corresponds to integrated luminosities equivalent 
to three times the data for BB events and two times 
the data for the continuum processes. Each Monte Carlo 
sample is reweighted to correspond to an integrated lu- 
minosity equivalent to the data. 

The data and MC samples in this analysis are pro- 
cessed and generated with consistent database conditions 
determined from the detector response and analyzed us- 
ing BaBAR analysis software release tools. 



III. EVENT RECONSTRUCTION 

In each event, we require a fully reconstructed hadronic 
B^ decay, which we refer to as the "tag" B meson candi- 
date or Stag. We then search for the signal B — hrt 
decay in the rest of the event, which we refer to as 
the "signal" B meson candidate or i?sig. The notation 
B hri refers to one of the following eight final states 
that we consider, where the primary hadron h is a K or 
TT and the primary lepton ^ is a /i or e: B^ — ^ K^t^ ^i^ , 
B+ K+T+fi-, B+ K+T-e+, B+ K+r+e-, 
B+ n+T^^+, B+ n+T+fi^, B+ n+T^e'^, and 
B^ TT+r+e^. In all cases, we require that the r de- 
cays to a "one-prong" final state (t — evv, r — fivV, 
and T — > {mr^)^!^ with n > 0). The branching fraction 
for r decays to a one-prong final state is 85%. 

The T{4:S) — s> B^B^ decay requires the i3sig three- 
momentum to be opposite from that of the Stag (— Ptag) 
and the i?sig energy to be equal to the beam en- 
ergy (i?beam) in the e+e~ center-of-mass (CM) reference 
frame [l3|. These constraints allow us to reconstruct the 
r indirectly using 

Pr = -Ptag -Ph -Pi, 
Er = Ebcam — E^ — Eg, 

rur = ^El - \vr\\ 

where (_E^, pV), (i?/i, p)j), and (Ei, pi) are the corre- 
sponding four-momenta of the reconstructed signal ob- 
jects. The indirectly reconstructed r mass (mi-) peaks 
sharply at the true r mass in _B — > hrt signal events 
and has a very broad distribution for combinatorial back- 
ground events. To avoid experimental bias, we did not 
look at events in the data with m,- within ±175MeV/c^ 
of the nominal r mass until all analysis procedures were 
established. 



A. Tag B reconstruction 

The i?tag is fully reconstructed in one of many final 
states Q of the form B' D^*^°X-. The notation 
£)(*)o j-gfgj-g to either a or a Z?*° which decays to 
either D'^j or D^tt". The Z?" is reconstructed in the 
K^TT^, ^7r+7r^7r+, X^tt+tt^, and i^^TT+Tr" channels, 
with Kg — > TT+TT^ and 7r° — > 77. The represents 
a system of charged and neutral hadrons composed of 
niTT^, 7^2 if^, n^Kg, and n47r°; subject to the constraints 
ni + n2 < 5, 713 < 2, ri4 < 2, and total charge —1. 

Each distinct i?tag decay mode has an associated a 
priori purity, defined as the number of peaking events 
divided by the number of peaking plus combinatorial 
events, where peaking and combinatorial yields are ob- 
tained from fits to Toes = \/ -E-boam ~ l-PtagP distributions 
for each distinct Btag decay mode. We only consider _Btag 
decay modes with a purity greater than 10% and choose 
the Stag candidate with the highest purity in the event. 
If there is more than one i?tag candidate with the same 
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purity, we choose the one with reconstructed energy clos- 
est to the beam energy. The -Stag candidate must have 
Toes > 5.27GeV/c^ and E'tag within three standard de- 
viations of i?bcam- A charged i?tag candidate is properly 
reconstructed in approximately 0.25% of all BB events. 



B. Particle identification 

PID algorithms are used to identify kaons, pions, pro- 
tons, muons, and electrons. We use an error correct- 
ing output code (ECOC) algorithm [l^ with 36 input 
variables to identify electrons, pions, and protons. The 
ECOC combines multiple bootstrap aggregated decision 
tree binary classifiers trained to separate e,Tr,K, and p. 
The most important inputs for electron identification are 
the EMC energy divided by the track momentum, sev- 
eral EMC shower shape variables, and the deviation from 
the expected values divided by the measurement uncer- 
tainties of the Cherenkov angle and of the dE/dx for 
the e, TT, K, and p hypotheses. Neutral clusters in the 
EMC that are consistent with bremsstrahlung radiation 
are used to correct the momentum and energy of electron 
candidates. A 7 candidate from an track is consistent 
with bremsstrahlung radiation if the corresponding three- 
momenta are within |A6'| < 35mradand |A(/)| < 50mrad, 
with respect to the polar and azimuthal angles of the 
beam axis. 

Muons and kaons are identified using a bagging deci- 
sion trees [l6j algorithm with 30 (36) input variables for 
the muon (kaon) selection. For muons, the most impor- 
tant input variables are the number and position of the 
hits in the IFR, the difference between the expected and 
measured DCH dE/dx for the muon hypothesis, and the 
energy deposited in the EMC. For kaons, the most im- 
portant variables are the kaon and pion likelihoods based 
on the measured Cherenkov angle in the DIRC and the 
difference between the expected and measured dE/dx for 
the kaon hypothesis. 

We define several quality levels of particle identifica- 
tion for use in the analysis. The "loose" levels have 
higher efficiency but also higher misidentification prob- 
abilities. The "tight" levels have lower misidentification 
probabilities and eflticiencies. Table |I] summarizes the se- 
lection efficiency and misidentification probabilities of the 
PID selection algorithms used. A "very loose" (VL) K- 
PID algorithm is used for identifying the primary K in 
B Kt£, while a "very tight" (VT) K-PID algorithm, 
with lower efficiency but much smaller misidentification 
probability, is used to reject Bgig candidates where a non- 
kaon track passes the the VT i^-PID criteria. Four qual- 
ity levels of /i-PID are used. In order of decreasing ef- 
ficiency and misidentification probability, they are Very 
Loose (VL), Loose (L), Tight (T), and Very Tight (VT). 



TABLE I: PID efficiencies and misidentification probabilities 
for the algorithms used in the analysis. The values are ap- 
proximate and representative only for the laboratory frame 
momentum (piab) specified (when given). More than one al- 
gorithm is used for kaons and muons. The abbreviations VL, 
L, T, and VT stand for selection quality levels Very Loose, 
Loose, Tight, and Very Tight. 



Type 


Efficiency 


misidentification probability 


K-YL 


> 95% 


< 0/0 for TV and fi with piab < 3.5 GeV/c 


K-VT 


> 85% 


~ 1% for TV and /i with piab < 3.5 GeV/c 


TV 


> 98% 


< 20% for K 


P 


?^ oU/o 


r\ pro/ -P/~,„ X^r ^ ^ 

< U . /o tor i\ ^ TV , fi, e 


/i-VL 


«90% 


< 15% for TV with piab < 1.25 GeV/c, 
< 4% for TV with piab > 1.25 GeV/c 


fi-h 


^80% 


< 5% for TV with piab < 1.25 GeV/c, 
< 2% for TV with piab > 1.25GeV/c 


fi-T 


^75% 


< 3% for TV with piab < 1.25 GeV/c, 
« 1% for TV with piab > 1.25GeV/c 


/i-VT 


^ 70% 


< 2% for TV with piab < 1.25 GeV/c, 
< 1% for TV with Piab > 1.25GeV/c 


e 


95% 


< 0.2% for Tv,K,p 



C. Signal B reconstruction 

The eight B — s- hri decay modes are independently 
analyzed. Tracks for the signal B reconstruction must 
satisfy the following criteria: the distance of closest ap- 
proach (DOCA) to the beam axis in the transverse plane 
must be less than 1.5 cm; the z position of the DOCA 
point must be less than 2.5 cm from the primary ver- 
tex of the event; the transverse momentum must be 
> 50 MeV/c; and the momentum must be < 10 GeV/c. 
After selecting the best i^tag candidate, we require ex- 
actly three tracks satisfying the above criteria remain in 
the event (excluding the Stag daughters) and that the 
sum of the charges of these tracks be the opposite of the 
Stag candidate charge. We refer to these three tracks as 
the i?sig daughters. 

We require the primary hadron, which is the h in B ^ 
hri, to be one of the two Sgig daughters with the same 
charge as the iJgig candidate. The primary hadron must 
pass the X-VL-PID criteria for the B — > Kt£ modes 
and the tt-PID criteria for the B ttt£ modes. For 
the B — Kt£ modes, if both of the Ssig daughters with 
the same charge meet the minimal K-PID criteria, the 
one with the highest K-PlD quality level is selected as 
the primary K^. If they have the same K-PID quality 
level, we choose the one with the lower momentum as 
the primary K^. For the B — > ttt£ modes, if both Bgig 
daughters with the same charge meet the tt-PID criteria, 
we choose the one that gives rrir closest to the true r 
mass. This algorithm does not produce an artificial peak 
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in the signal window of the background rrir distribution. 
Once the primary hadron candidate has been assigned, 
the T daughter and primary lepton are uniquely defined 
for a given B — ^ hri mode from the remaining two _Bsig 
daughters based on their electric charge. 

The primary lepton, which is the £ in B ^ hri, must 
pass either the e-PID or the loosest ^-PID criteria (/i- 
VL). We remove events where any of the three Bsig 
daughters passes the p-PID criteria, or where any of the 
three Sgig daughters passes the X-VT-PID criteria, with 
the exception of the in B ^ Kri. 

By requiring exactly three Bsig daughters, we are re- 
stricting the selection to one-prong r decays. For each of 
the eight B hrl modes, we divide the selection into 
three r decay channels: electron, muon, and pion. From 
now on, we use "modes" to refer to types of i? — !■ hrt 
decays and "channels" to refer to types of t decays. The 
three r decay channels are analyzed in parallel, with dif- 
ferent background rejection criteria applied. If the r 
daughter satisfies the e-PID criteria, the event is assigned 
to the electron channel. If the t daughter does not satisfy 
the e-PID, but does satisfy the /i-VL-PID criteria, the 
event is assigned to the muon channel. If the t daughter 
passes neither the e-PID or the ^-VL-PID, the event is 
assigned to the pion channel. This ensures that an event 
does not get double counted and categorized into another 
T decay channel for a given B hri mode. 

Background events with a _B — > h{cc); (cc) — 
decay can pass our signal selection criteria. We remove 
events in the electron (muon) and pion r decay chan- 
nels of the B ~> hre [B hTfi) modes if the invariant 
mass of the primary lepton and t daughter, mu^ is con- 
sistent with a dilepton charmonium decay: 3.03 < mu < 
3.14GeV/c2 for the J/ip or 3.60 < m« < 3.75GeV/c2 
for the 'ijj{2S). The core dilepton invariant mass reso- 
lution for these charmonium decays is on the order of 
12 MeV/c^. These charmonium vetos effectively remove 
the charmonium background at a minimal cost in signal 
efficiency. We also require m« > 0.1 GeV/c^ for B — > hre 
candidates in the electron and pion channels to remove 
candidates where the primary electron and the r daugh- 
ter are consistent with originating from a photon conver- 
sion. 



D. BB background and the m{KTr) invariant mass 
requirement 

After the selection described above, the dominant 
background is due to BB events, where the Stag is prop- 
erly reconstructed. However, the largest background 
source differs depending on the charge of the primary 
lepton relative to the charge of the Bgig candidate. 

When the primary lepton charge is the same as the 
Bsig charge, such as a B~^ — >■ K^t~£~^ candidate, the 
dominant background comes from semileptonic B decays, 
such as B+ D° K+X-, where con- 

tains a 7r~, e^, or fi^ and perhaps other charged and/or 



neutral daughters that are not reconstructed. For exam- 
ple, the final state tracks K'^tt~£'^ are identical for this 
background with D° K+tt^ and the B+ K+t^£+ 
signal decay with t~ ■k~Vt. On the other hand, when 
the primary lepton charge is opposite to the Ssig charge, 
such as for a B^ K^r^i^ candidate, the dominant 
background comes from semileptonic D decays, such as 
B+ D° K+i-Pe. 

To reduce these backgrounds, we reject i?sig candidates 
where two of the iSgig daughters are kinematically com- 
patible with originating from a charm decay, as described 
below. For the four B — >■ Kri modes, we define the vari- 
able •m{K'K) as the invariant mass of the primary K and 
the i?sig daughter that has opposite charge to this K. In 
computing mlKn), the non-K track is assumed to be a 
pion. Distributions of m{K'ri) for the background and 
signal MC are shown in Fig. [T] for i? — > KTji. For the 
four B — >■ ■nrl modes, we define m{K'K) by combining 
two i?sig daughters that have opposite charge. Of the 
two Ssig daughters with the same charge as the Bgig can- 
didate, we choose the one with the highest K-PIT) quality 
level. We assume that the kaon is one of the i?sig daugh- 
ters with the same charge as the Bsig candidate and the 
pion is the i?sig daughter with the opposite charge as the 
Bsig candidate. If the two Bgig daughters with the same 
charge as the Bsig candidate have the same i^-PID qual- 
ity level, we use the daughter with higher momentum as 
the kaon in the m^Kn) calculation. 

We require m{KTi) > 1.95GeV/c^. This rejects be- 
tween 97% and 99% of the background while retaining be- 
tween 32% and 37% of the signal for the B+ h+T-t+ 
modes. For the B^ — 7r+T+^~ modes, the m{Kn) 
requirement rejects 85% and 89% of the 7r+r+^^ and 
7r+r+e~ background while retaining 72% and 65% of the 
signal, respectively. For the B^ K~^T~^i~ modes, the 
m{KTT) requirement rejects 92% and 96% of the K'^t^^^ 
and K~^T~^e~ background while retaining 63% and 62% 
of the signal, respectively. 

IV. B D^*">°lu CONTROL SAMPLE 

We select a control sample of semileptonic B decays 
of the form B+ D^*'>°i+iy; D° if+Tr" by requir- 
ing m{K'K) to be near the D° mass, 1.845 < m{KTr) < 
1.885 GeV/c^. The D'^*'^^iv control sample has a negligi- 
ble amount of combinatorial background. In our search 
for B — ^ hTi, we normalize the B — > hrl branching frac- 
tion by using the measured yield taken from the 
control sample. We determine the relative amounts of 
B mesons that decay to 1)*°, and higher resonances 
[D**^) using the reconstructed CM energy difference 

El, = Pi,= |-Ptag -PK -p-n - Pi\ , 

For 5+ —5- D^l^v decays, AEjj^i, is centered at zero. 
The missing neutral particles from and decays 
shift AEoiv in the negative direction. 
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FIG. 1: Distributions of m{KTT) for the (a, b) B+ K+t~ 



{mv°)-K-u^ and (c, d) B+ -> Jf+r^ 



(n7rO)7r^ 



channels. The top row shows the data (points) compared with the background MC (solid line). The area of the background 
MC distribution has been normalized to the area of the data distribution. The bottom row shows the (b) — >■ K^t~ fi'^ and 
(d) B'^ — > Js'^r^/i" signal MC. The normalization of the bottom row is arbitrary. The dotted vertical line is at 1.95GeV/c^, 
which is the minimum allowed value of m{K'K) for the signal selection. The peak in the top row just below 1.95 GeV/c^ is from 
K^TT~ decays. 



The expected observed yields of D£v and hri as func- 
tions of their branching fractions are given by 

Noei^ — NQBoiy^^^g ^Div, (1) 

Nhrl ~ NoBhri^tli ^hre, (2) 

where A^o is the number of BB events, Bdii^ (Bhri) is the 
branching fraction for B Dii' {B ^ hrt), eg^^" (e{'4^) 

is the Btug reconstruction efficiency in BB events that 
contain a Div {hrt) decay on the signal side, eotu {(-hrt) 
is the signal-side reconstruction efficiency for Dtv (hri), 
and the symbol D£i^ represents either 5+ D*^t'^v or 
5+ — !■ D^l^v. Solving for the expected hrt event yield 
gives 

Nhri — Bhrl ShTl So, (3) 

where we have defined a common factor 

^0 = (^] ■ (4) 

Boiueoeu \etag / 

Table Hi] gives the tag-side efficiency ratios determined 
from MC samples. We find the ratios to be close to one, 
indicating that the signal-side decay does not strongly 



TABLE II: Tag-side reconstruction efficiency ratios deter- 
mined from MC samples. The uncertainty includes both sta- 
tistical and systematic sources. 



Efficiency Ratio 


[1, modes 


e modes 


^tag / ^tag 
tag / tag 


0.96 ±0.05 
0.95 ± 0.04 


0.98 ±0.07 
0.97 ±0.06 



influence the tag-side reconstruction efficiency, and does 
not depend on the primary lepton or hadron flavor. 

Figure [2] shows the results of unbinncd maximum like- 
lihood fits of the AEdi^ distributions for the B'^ ^■ 
and B+ ^(*)o_e+t/ control samples. The 
fits have independent D^, D*^ , and components. 
Any residual combinatorial background is included in the 
D**^ component. The and D*^ component probabil- 
ity density functions (PDFs) are each modeled with the 
sum of a Gaussian and a Crystal Ball function JTi] . The 
I?**" component PDF is the sum of a Gaussian and a bi- 
furcated Gaussian, which has different width parameters 
above and below the mean. The overall normalization 
of each component, the core Gaussian mean and width 
of the component, and the relative fraction of the 
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Crystal Ball function within the component are all 
parameters of the likelihood that are varied in its maxi- 
mization. 

The results of the AE]je,y maximum likelihood fits and 
So calculations are given in Table IIIIl We use the fol- 
lowing branching fractions [3| in the calculation of Sq'- 
B{B- -> D^i-D) = (2.23 ±0.11)%, B{B- ^ D*^l-D) = 
(5.68 ± 0.19)%, and B{D^ K--K+) = (3.87 ± 0.05)%. 
The four determinations of Sq are all consistent with each 
other, as expected. 




AE'°^^'(GeV) 




FIG. 2: (color online) Distributions of the three- component 
AEdiu unbinned maximum likelihood fits of the data for the 
(a) B D**)" fiiy and (b) B D^'^^ev control samples. 
In each plot, the points represent the data, the solid blue 
curve is the sum of all PDFs, the long-dashed green curve 
is the component, the dot-dashed purple curve is the D*^ 
component, and the dotted blue curve is the D"'^ component, 
which also includes any residual combinatorial background. 



V. CONTINUUM BACKGROUND REJECTION 

After the m{Kn) > 1.95GeV/c^ requirement, the BB 
background is highly suppressed. The remaining back- 
ground is dominated by continuum quark-pair produc- 
tion (e^e~ — qq] q — u,d,s,c). We combine the vari- 
ables described in this section in a likelihood ratio 



TABLE III: Results of the AEoii, maximum likelihood fits 
and So calculations. The uncertainties on Njjev and ejjev are 
statistical. The efficiency eoiv is determined from a Monte 
Carlo sample. The uncertainty on So includes the uncertain- 
ties on the B and D branching fractions. 



D£i' mode 






So 




513 ± 38 


(47.8 ± 0.9)% 


(12.0 ± 1.2) X 10^ 




1234 ± 49 


(50.8 ± 0.5)% 


(10.7 ±0.8) X 10^ 


D°ev 


484 ± 46 


(48.2 ± 0.9)% 


(11.4 ± 1.5) X 10^ 


D*°eu 


1368 ± 58 


(52.2 ±0.5)% 


(11.7 ± 1.1) X 10^ 



(5) 



where Xi is one of a set of variables that discriminate 
against background, and Ps{xi) {Pb{xi)) is the PDF for 
variable Xi in signal (background) events. 
The variables used in the Lr calculation are: 

• I cos 0thr I the absolute value of the cosine of the 
angle 0thr between the i?tag thrust axis and the 
thrust axis of the remainder of the event (=i3sig); 
the thrust axis is defined as the direction a which 
maximizes a-pj, where j represents all particles 
assigned to a particular B candidate, 

• ^ Eca\ the scalar sum of all EMC neutral clus- 
ter energy that is not associated with the -Stag 
candidate or bremsstrahlung radiation from any e 
candidates, where the threshold cluster energy is 
100 MeV (50 MeV) in the forward (barrel) region 
of the detector, 

• primary /x-PID quality level, where, for the 
B — ^ /iT/i modes, we include the highest quality 
level (VL, L, T, VT) of the primary /i candidate, 
and 

• secondary /x-PID quality level, where we in- 
clude the highest quality level (VL, L, T, VT) of 
the T-daughter /i candidate, if applicable. 

We fit histograms of the | cos 0thr | and Ecai signal 
and background MC distributions using polynomials of 
up to order eight to define the PDFs for those variables. 
The PDFs for the muon-PID quality level are normalized 
histograms, with one bin for each muon-PID quality level. 

For each of the eight signal B decay modes, we con- 
struct a distinct Lr for each of the three r channels (e, 
II, and tt). This corresponds to 24 different likelihood ra- 
tios. In the final selection, described in section IVIIIl we 
impose a minimum Lr requirement for each r channel in 
each of the eight B hri modes. 

Figure [3] shows the background and signal | cos " 
distributions for the tt channel of the B^ K'^t 
mode. The continuum background peaks sharply near 
cos6'thi| = 1 because the events have a back-to-back 
jet-like topology. The signal |cos6'thr| distribution is 



thrl 
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roughly uniform because the detected decay products in 
BB events are more isotropically distributed. 



VI. SIGNAL AND BACKGROUND 
ESTIMATION 
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FIG. 3: Distributions of |cos^thr| for background (top) 
and signal MC (bottom), for the 5+ — i> K^t^ ji^; — ^ 
{n-K^)-K~ Vr channel. The points (solid line) in the top figure 
are the data (background MC). The background MC has been 
normalized to match the area of the data distribution. The 
normalization of the signal MC is arbitrary. The solid red 
curve is the result of the polynomial fit of the MC distribu- 
tion. 



Figure |4] shows -^cai distributions for the three t 
channels of the B'^ — >■ if+T~/x+ mode. The events where 

^cai — 0, due to the absence of unassociated neutral 
clusters above the minimum energy threshold, are not in- 
cluded in the polynomial fit and treated separately. The 

-^cai = events are plotted below zero in Figure S] for 
clarity. The signal MC ^ i?cai distributions peak at zero, 
as expected, while the background rarely has ^ E'cai — 
but rather has a distribution that peaks between 1 and 
2 GeV. The signal MC ^ E'cai distributions for the tt 
channel extend to higher values, compared to the e and 
/i channels, due to hadronic r decays that produce a sin- 
gle TT^ with one or more neutral pious. 

Figure [S] shows background and signal MC distribu- 
tions for the _B+ — > K^t^ ji^ ; {mi^)-K~ Vr chan- 
nel. The background peaks sharply near zero and the 
signal peaks sharply near one. The value of the L]^ selec- 
tion for each r channel in each of the eight signal modes 
is chosen by determining the lowest upper limit on the 
branching fractions under the null hypothesis with MC 
pseudo-experiments. We vary the minimum Lj^ require- 
ment in intervals of 0.05. 



In our signal selection, we require the indirectly recon- 
structed T mass rur to be within ±60 MeV/c^ of the world 
average r mass 1.777 GeV/c^ [ll|. The relative signal effi- 
ciency after the m^- signal window requirement is around 
84% (78%) for the B hr^i {B hre) modes. We opti- 
mized the rrir signal windows, considering windows in the 
range of ±50 MeV/c^ to ±175 MeV/c^. Our optimization 
metric was the average expected signal branching fraction 
90% confidence level upper limit from a set of toy exper- 
iments simulating background-only datasets. In each toy 
experiment, we generate a value for the observed number 
of events in the signal window using a random number 
that we take from a Poisson distribution with the mean 
value set to the expected number of background events. 
We find that a mr signal window of ±60 MeV/c^ gives 
the lowest expected branching fraction upper limits for 
all r decay channels. 

The background distribution in is very wide and 
slowly varying. We use a broad m,- sideband from to 
3.5 GeV/c^, excluding the signal window, to estimate the 
background in the tjIt signal window with 



RbNs, 



(6) 



where b is the number of background events in the signal 
window, Nsb is the number of background events in the 
rrir sideband, and Rh is the expected signal-to-sideband 
ratio (b/Nsb)- The ratio Rt is determined from the ratio 
of selected background events in the itIt signal window 
(6) and the rrir sideband {Ngb) in the background Monte 
Carlo. 

Figures [S] and [7| show the observed, signal MC, and 
background MC m^. distributions for the B Kt£ and 
B — > ttt£ modes, respectively. Table ITVl gives the results 
for the observed numbers of sideband events Nsb,i, signal- 
to-sideband ratios Rb^i, expected numbers of background 
events hi, numbers of observed events n^, and signal ef- 
ficiencies ehTe,i for each r channel i. All of the observed 
numbers of events in the rrir signal window are statis- 
tically consistent with the expected backgrounds bi, thus 
there is no evidence for any B hri decay. 



VII. 



SYSTEMATIC UNCERTAINTIES 



Since we normalize our B — > hrl signals using the 
B — D^*^^ii' control sample, many systematic uncer- 
tainties cancel, such as the ones coming from the absolute 
Stag efficiency uncertainty and the tracking efficiency un- 
certainty. We evaluate systematic uncertainties on the ef- 
ficiency of the minimum requirement by varying the 
signal and background PDFs for each Lji. We use the 
B — >■ D^*^^£v control sample in place of the signal Monte 
Carlo as a variation of the signal J2 ^cai PDF. A uniform 
distribution is used in place of the nominal polynomial 
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E (GeV) E E,,,, (GeV) E E,,, (GeV) 

FIG. 4: Distributions of ^ -Bcai for background (top) and signal MC (bottom), for the B"*" — >■ K^t~ fi^ mode; r~ — !> e'Vei'T 
(left), T~ ^~v^Vr (middle), and t~ — >■ {n-K^'')'K~ Vt (right). The events where X^i?cai = have been separated from the main 
distribution and plotted in a bin below zero for clarity. The points (solid line) in the top figure are the data (background MC). 
The background MC has been normalized to match the area of the data distribution. The normalization of the signal MC is 
arbitrary. The solid red curve is the result of the polynomial fit of the MC distribution. 
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FIG. 5: Likelihood ratio {Lr) output distributions of 
background (top) and signal MC (bottom), for the — )■ 
TT Ut channel. The points (solid line) 
in the top figure are the data (background MC). The back- 
ground MC has been normalized to match the area of the data 
distribution. The normalization of the signal MC is arbitrary. 



fit as the variation of the signal | cos6'thr| PDF. The ef- 
ficiency for each lepton PID level is varied by ±2.5% for 
the VL,L, and T levels and ±3.2% for the VT level. The 
data rrir sideband is used in place of the Monte Carlo as 



a variation of the background PDFs. 

Our largest sources of systematic uncertainty come 
from variations in modeling the data distributions of the 
^ EcaX and | cos 0thr I Lr inputs when compared to the 
nominal background MC PDFs. The changes in ehTt,i 
from the variations are added in quadrature. We deter- 
mine systematic uncertainties as high as 1.1%, with the 
largest ones coming from the B'^ — > /f+r+e^; t+ — > 
e'^Ve^T and t'^ — > (n7r'')7r"'"tv channels. 

The B tttI modes require tt-PID, while the B — s- 
D^*^^£i' control sample requires A'-PID. We evaluate a 
systematic uncertainty on CTiTi/^Div by measuring the 
TT-PID and X-PID efficiencies using the B D(*)o^j/ 
control sample with and without the if-PID or tt-PID re- 
quirements. The measured efficiencies in data are consis- 
tent with the MC simulation. Based on the results from 
the B — > D^*^°iiu and B — >■ D'*'"e:/ samples, we assign 
systematic uncertainties of 1.8% and 1.0% to £TTTfj./^Dfj.u 
and e-nre/^Dev, respectively. 

The uncertainty on the signal-to-sideband ratio Rb is 
the statistical uncertainty from the Monte Carlo sample 
used to determine its value. Figures [S] and [7] show good 
agreement between the Monte Carlo and observed data 
distributions in the sidebands. No additional systematic 
uncertainty is included in i?f,. 

The tag efficiency ratio Ctag^/^tag" is evaluated using 
two independent Monte Carlo samples: one where the 
tag-side B meson decays to all possible final states and 
another where the tag-side B meson is forced to decay 
to most of the modes that comprise the tag-side recon- 
struction. The value of the ratio is taken from the first 
sample. The systematic error on the ratio is the differ- 
ence in the ratio between the two samples. The overall 
uncertainty on the ratio, given in Table HIl is the sum in 
quadrature of the statistical and systematic uncertainties 
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on the ratio. 



VIII. BRANCHING FRACTION RESULTS 

We determine the branching fraction for each of the 
eight B — hrl modes using a hkehhood function which 
is the product of three Poisson PDFs, one for each of the 
three t channels. The expected number of events in a 
particular r channel is given by 

rii = Nhri.i + h (7) 

ni = Bhri ^hrlA So + bi, (8) 

where NhTt,i (bi) is the expected number of signal (back- 
ground) events in channel i. Total uncertainties on the 
signal efficiency ehre.i, common factor So, and expected 
background hi are included by convolving the likelihood 
with Gaussian distributions in ehre.i, Sq, and hi. 

We set 90% confidence intervals on the branching frac- 
tions of the eight B hrl modes assuming uniform 
three-body phase space decays using the likelihood ratio 
ordering principle of Feldman and Cousins [19] to con- 
struct the confidence belts. 

The 90% C.L. upper limits on the B hrl branch- 
ing fractions are between 1.5 x 10^^ and 7.4 x 10^^. 
Table IIVI includes the final results for the B — > hrl 
branching fraction and 90% C.L. upper limits. In Ta- 
ble |Vl we give combined results for B{B'^ — >■ h^rt) = 
B{B+ h+T-£+) + B{B+ h+T+e-) with the as- 
sumption B{B+ h+T-e+) = B{B+ h+T+ry 

In the analysis of Black, Han, He, and Sher [4[, the 
B — > Kt^ and B ttt/x branching fractions are propor- 
tional to A^^ and A^^, which are the new physics energy 
scales for the corresponding fermionic effective operators 
for these decays. Using the limits B{B^ — > n^Tfi) < 
7.2 X 10-5 and B{B+ K+Tfj.) < 4.8 x 10-^ we im- 
prove the model-independent bounds on the energy scale 
of new physics in flavor-changing operators reported in Q 
from A^^ > 2.2 TeV and A^^ > 2.6 TeV to A^^ > 11 TeV 
and A^^ > 15 TeV. 



[1] S. Weinberg, Phys. Rev. Lett., 19, 1264 (1967); S. L. 

Glashow, J. Iliopoulos, and L. Maiani, Phys. Rev. D 2, 

1285 (1970); see also J. Erler and P. Langacker in [H] 

and B. Kayser in [l^ . 
[2] X.-G. He, G. Valencia, and Y. Wang, Phys. Rev. D 70, 

113011 (2004). 
[3] M. Sher and Y. Yuan, Phys. Rev. D 44, 1461 (1991). 
[4] D. Black, T. Han, H.-J. He, and M. Sher, Phys. Rev. 

D 66, 053002 (2002). 
[5] T. Fujihara et al, Phys. Rev. D 73, 074011 (2006). 
[6] B. Aubert et al. {BABAR Collaboration), Phys. Rev. Lett. 

99, 201801 (2007). 
[7] B. Aubert et al. {BABAR Collaboration), Phys. Rev. 

D 77, 091104(R) (2008). 



IX. SUMMARY AND CONCLUSIONS 



We have searched for the lepton flavor violating decays 
B — > hri. We find no evidence for these decays and set 
90% C.L. upper limits on the branching fractions of a few 
times 10"^. The results for the B Kt^i mode super- 
sede our previous result [6|. The results for B — > Kre, 
B — )■ 7rr^, B — > Trre modes are the first experimental lim- 
its for these decays. We use our results to improve model- 
independent limits on the energy scale of new physics 
in flavor-changing operators [3] to Ai^ > 11 TeV and 
Ai^ > 15 TeV. 
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TABLE IV: Results for the observed sideband events Nsb,i, signal-to-sideband ratio Rb,i, expected background events bi, 
number of observed events n^, signal efficiency e^Tt.i (assuming uniform three-body phase space decays) for each r channel i 
and B — ^ hrl [9] branching fraction central value and 90% C.L. upper limits (UL). All uncertainties include statistical and 
systematic sources. 

8(3 hre) (x 10-^5) 





Mode 




T channel 




Rb.i 


bi 


rii 






central value 


90% C.L. UL 


B+ ^ 






e 

TV 


22 
4 
39 


0.02 ±0.01 
0.08 ± 0.05 
0.045 ± 0.020 


0.4 ±0.2 
0.3 ±0.2 
1.8 ±0.8 


2 

1 


(2.6 ± 0.2 
(3.2 ± 0.4 
(4.1 ± 0.4 


% 
% 
% 


0.8 t\i 


< 4.5 


B+ - 


K+T 




e 
M 

TT 


5 
3 

153 


0.03 ±0.01 
0.06 ± 0.03 
0.045 ± 0.010 


0.2 ±0.1 
0.2 ±0.1 
6.9 ± 1.5 




11 


(3.7 ±0.3 
(3.6 ±0.7 
(9.1 ±0.5 


% 
% 
% 


-0.4 tli 


< 2.8 


B+ 


K + T 


-e+ 


e 

TT 


6 
4 
33 


0.095 ± 0.020 
0.025 ± 0.010 
0.045 ±0.015 


0.6 ±0.1 
0.1 ±0.1 
1.5 ±0.5 


2 

1 


(2.2 ±0.2 
(2.7 ±0.6 
(4.8 ±0.6 


% 
% 
% 


".^ -1.0 


< 4.3 


B+ 


K+T' 




e 
M 

TT 


8 
3 

132 


0.10 ±0.06 
0.045 ± 0.020 
0.035 ±0.010 


0.8 ±0.5 
0.1 ±0.1 
4.6 ±1.3 




4 


(2.8 ± 1.1 
(3.2 ±0.7 
(8.7 ± 1.2 


% 
% 
% 


-1.3 


< 1.5 


B+ 


— ^ TT+r" 




e 
M 

TT 


55 
10 
93 


0.017 ±0.010 

0.11 ±0.04 
0.035 ±0.010 


0.9 ±0.6 
1.1 ± 0.4 
3.3 ±0.9 



2 

4 


(2.3 ±0.2 
(2.9 ±0.4 
(2.8 ±0.2 


% 
% 
% 


0.4 


< 6.2 


B+ 






e 
M 

TV 


171 
89 
512 


0.012 ± 0.003 

0.04 ± 0.01 
0.050 ± 0.005 


2.1 ±0.5 
3.6 ±0.9 

25 ±3 


2 
4 
23 


(3.8 ±0.3 
(4.8 ± 0.3 
(9.1 ±0.6 


% 
% 
% 


0.0 tl'o 


< 4.5 


B+ 




-e+ 


e 
M 

TT 


1 

16 
172 


0.050 ±0.025 
0.025 ±0.010 
0.035 ± 0.008 


0.1 ±0.1 
0.4 ±0.2 
6.0 ± 1.4 


1 
1 
7 


(2.0 ±0.8 
(2.8 ±0.3 
(5.8 ±0.3 


% 
% 
% 


2.8 


< 7.4 


B+ 




~e~ 


e 

TV 


31 
247 
82 


0.033 ±0.013 
0.012 ±0.005 
0.07 ±0.03 


1.0 ±0.4 
3.0 ± 1.2 
5.7 ±2.5 



2 
3 


(2.9 ±0.3 
(4.6 ±0.4 
(3.7 ± 1.0 


% 
% 
% 


-3.1 


< 2.0 



TABLE V: Branching fraction central values and 90% C.L. 
upper limits (UL) for the combination B{B+ — i- h+rl) = 
B{B+ ^> h+T-£+) + B{B+ -s> h+T+r) with the assumption 
b\b+ h+T-£+) = B{B+ h+T+r). The uncertainties 
include statistical and systematic sources. 







B{B hTt) 






Mode 


central value 


90% C.L. UL 


B+ 


^ K+Tll 


0.0 


< 4.8 


B+ 


K+TB 


-0.6 


< 3.0 


B+ 


TV+TfJ, 


0.5 ill 


< 7.2 


B+ 


TV+TE 


2.3 +_\i 


< 7.5 



